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Performance of local health services managers at district level is crucial to ensure that 
health services are of good quality and cater to the health needs of the population in 
the area. In many low- and middle-income countries, health services managers are poorly 
equipped with public health management capacities needed for planning and managing 
their local health system. In the south Indian Tumkur district, a consortium of five non- 
governmental organizations partnered with the state government to organize a capacity- 
building program for health managers. The program consisted of a mix of periodic contact 
classes, mentoring and assignments and was spread over 30 months. In this paper, we 
develop a theoretical framework in the form of a refined program theory to understand 
how such a capacity-building program could bring about organizational change. A well- 
formulated program theory enables an understanding of how interventions could bring 
about improvements and an evaluation of the intervention. In the refined program theory 
of the intervention, we identified various factors at individual, institutional, and environmen- 
tal levels that could interact with the hypothesized mechanisms of organizational change, 
such as staff's perceived self-efficacy and commitment to their organizations. Based on 
this program theory, we formulated context-mechanism-outcome configurations that can 
be used to evaluate the intervention and, more specifically, to understand what worked, for 
whom and under what conditions. We discuss the application of program theory develop- 
ment in conducting a realist evaluation. Realist evaluation embraces principles of systems 
thinking by providing a method for understanding how elements of the system interact 
with one another in producing a given outcome. 
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INTRODUCTION 

The local health system at the district level is an important orga- 
nizational unit for management of health services. In India and 
many other low- and middle-income countries (LMICs), doc- 
tors are usually in charge of the management of local health 
systems. As health managers, doctors lead a team of health work- 
ers that includes other doctors and clinical specialists, nurses 
and midwives, pharmacists, laboratory and other technicians, and 
administrators. A well-functioning local health system is able to 
translate its inputs (human, financial, and technical resources) into 
processes and outputs (health care). In addition, it should ensure 
that the health care provided is organized and managed in such 
a way that it is physically and financially accessible, equitable, of 
good quality, and responsive to local needs (1). 

Many district health systems in LMICs do not have the capac- 
ity to allocate their financial resources equitably and manage 
their technical resources optimally (2). Furthermore, the health 
workforce is unequally distributed leading to skill mix problems 
(3). This affects the quality of the healthcare provided and thus 
the health status of the people. Moreover, in the absence of a 
well- functioning local health system, disease -control programs are 
hampered in achieving their goals, in spite of their good design. 



Indeed, there are instances of such programs failing or even hav- 
ing a harmful effect on hesilth systems, specifically on planning, 
monitoring, and evaluation (4-6). 

It is now generally acknowledged that strong health systems are 
needed, but studies and reviews on health system strengthening 
and more specifically on capacity-building in health (and how it 
improves performance) are few [Ref (7), see Box 1]. In parallel, 
attention for complexity in health is growing. There have been 
calls for increasing scientific evaluation of complex interventions 
in health to improve our understanding of what works for whom 
and under what conditions (8-12). 

We have developed a realist evaluation study to understand how 
capacity-building of health managers translates into improved 
performance with respect to their planning and supervision in 
Tumkur district of Karnataka state in southern India ( 15). A real- 
ist evaluation aims to produce a context-specific understanding 
of the mechanisms through which a given outcome is produced 
[Ref ( 16), see Box 2] . The first step toward understanding how an 
intervention produces the expected outcomes is to understand the 
intervention and all its elements, and gain insight into how it inter- 
acts with the actors and the various components of the recipient 
health system. Capacity-building programs of health workers are 
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Box 1 I Capacity-building through! training programs: what do we l<now? 

As an alternative to systematic reviews, realist synthesis is emerging as a way to expand our knowledge base, especially when attempting to 
answer context-sensitive and policy-relevant questions (13, 14). A realist synthesis begins with the question: "what works for whom under 
what circumstances, how and why?" (13, 14). A recently published realist synthesis of human resource management (HRM) interventions 
in LMICs could identify only 48 scientific articles, of which 21 were related to capacity-building through training programs (7). In these 21 
articles, the synthesis reports that "... the mechanisms through which training produced changes were researched in (only) three studies " 
The report found that "... improvement of health worker performance was triggered by three distinct mechanisms: improved knowledge 
and skills, critical awareness on the functioning of health services, and being empowered to implement change." 



Box 2 1 Realist evaluation begins by asking (about programs or policies), what works, how, in which conditions, and for whom (17) 

The outcome of a realist evaluation is an empirically tested and context-specific explanation for why the program or policy worked for 
some and not for others. The evaluators begin by refining the initial program theory of the program (or policy); the initial program theory 
is based on the assumptions made by the designers/implementers on why the inputs of the program will bring about the desired output. 
The evaluator seeks to refine this initial program theory in order to understand the local contextual conditions that influence the outcome, 
as well as the possible causal mechanisms that could have resulted in the outcome. Data are collected and analyzed using the conjectural 
context-mechanism-outcome (CMO) configurations; configurations consisting of causal mechanisms that explain the observed outcome, 
in relation to specific contextual conditions that allow for these mechanisms to operate. The CMO configurations are an analytical tool 
consisting of testable conjectures drawn from the program theory that help in generating an explanation for what works, for whom, and 
under what conditions. The current understanding of context and mechanism in realist evaluation is summarized below (18). 

Context - actors or other factors that occur in the setting where the intervention/policy was implemented, that occur independent of the 
intervention/policy, and affect the implementation of the intervention/policy. 

Mechanisms - psychological or social explanations for human behavior that explain the interaction between social structure and 
individual/group agency. 



embedded in the existing organizational and socio-political con- 
text of the area where they are implemented. Hence, in addition 
to the program inputs, the relationships between the actors in the 
system and the interaction between the program elements and the 
recipient health system, affect the program outcomes. 

The frameworks used to describe and analyze health systems 
have evolved in response to the acknowledgment of complex- 
ity of these systems (1, 19-21). The response of providers and 
managers of hospitals or health centers to a given intervention 
will depend on the dynamic interactions between various factors 
operating at different levels in their system. Hence, interventions 
at district level could result in positive change in some people or 
in some institutions, while not in others. In order to understand 
how a given intervention could bring about positive organizational 
change, the interaction between and among the various individ- 
uals within the sub-units of the system needs to be analyzed. A 
systems' approach to address complexity within a district health 
system requires that the relationships between the sub-units of 
system, and the possible ways in which they could interact and 
affect the production of the outcome, should be understood and 
made explicit (see Figure 1). 

Recent evaluation studies have called for approaches that help 
unpack the black-box between an intervention's inputs and its out- 
comes (23, 24). These studies are centered around the development 
of a program theory approach that allows for the formulation of 
a plausible basis for expected outcomes, drawing from the body 
of knowledge on the given intervention (literature), as well as 
building on the role of local context in shaping these outcomes. 

In this paper, we progressively develop the program theory 
of the capacity-buUding intervention, which was launched in 



Tumkur, India in 2009. The intervention involved training of 
health managers on public health management topics through a 
mix of classroom teaching and mentoring at their workplace. The 
formulation of a program theory enables identification of plausi- 
ble mechanisms through which organizational change could have 
occurred, and the contextual factors that triggered these mecha- 
nisms. In realist evaluation, the mechanisms could be understood 
as the agency through which the resources introduced into the sys- 
tem by the program produce the outcome. However, context, in the 
form of the appropriate external environment (or not), is critical 
for the manifestation of the outcome (17). A detailed descrip- 
tion of the intervention is provided in File SI in Supplementary 
Material. 

MATERIALS AND METHODS 
THE STUDY SEHING 

In India, local health systems at the district level are generally 
organized in three tiers. The first point of contact between people 
and healthcare professionals is a network of Primary Health Cen- 
ters (PHC), which depend on a hospital at the sub-district level 
(taluka) for secondary care. A district hospital is supposed to pro- 
vide tertiary specialty care. On average, a district in India has a 
population ranging from 500,000 to a few million people. A sub- 
district (called taluka in Karnataka) would generally have a few 
hundred thousand inhabitants. The production of healthcare out- 
puts of hospitals and health centers is complex; it is influenced by 
the internal dynamics of the workforce in these organizations, by 
the relationships among individual health workers, as well as by 
their external environment (25). Environmental factors include 
local socio-political, governance, and policy influences from the 



Frontiers in Public Health j Public Health Education and Promotion 



July 2014 I Volume 2 | Article 89 | 2 



Prashanth et al. 



Capacity-building of health managers In India 




FIGURE 1 I A generic representation of an intervention and its interaction 
with tlie district health system and its various sub-units (Su). Sub-units 
could include hospitals, disease-control programs, or talukas (sub-districts). A 



district level Intervention Interacts within and among the constituent local 
health systems in the district as well as the policy environment of the 
district (22). 



higher levels in the system. An overview of the organization and 
management of health services in Karnataka state and the policy 
context within which the intervention operated is summarized in 
File S2 in Supplementary Material. 

We developed the program theory in a step-wise fashion based 
on guidance in literature (16, 17, 26). We first summarized prior 
theory and research on the subject, then collected data on con- 
textual factors that could affect the expected outcomes of the 
intervention, and finally formulated the implicit theory of the 
intervention. Based on this program theory, we eventually devel- 
oped CMO configurations helping us to understand how the inter- 
vention could have worked, for whom, and under what conditions. 
A realist evaluation of health management interventions builds 
upon such CMO configurations in order to generate plausible 
explanations on how this intervention could have worked (24, 27). 

The steps followed are described below and summarized in 
Table 1. 

( 1 ) Understand the intervention (initial program theory, IPT) : we 
started with eliciting the IPT of the intervention. These are the 
assumptions and hypotheses of the designers of the interven- 
tion and other stakeholders. To do so, we reviewed program 
documents (list of documents in File S3 in Supplementary 
Material) to identify the implementers' main assumptions, to 
understand the perceptions of the key actors and to identify 
potential mechanisms - if any - as identified by the imple- 
menters. Implementers are the people and organizations who 
designed and are in charge of the implementation of the inter- 
vention. At this stage, we were looking for assumptions of the 
designers on how and why the program would bring about the 
expected outcomes. In a second step, we interviewed 16 actors 
using an interview guide (FUe 84 in Supplementary Mate- 
rial): 2 program designers, 2 policymakers, 10 participants 



(health managers), and 2 health services staff during the early 
phase of the implementation of the intervention. The inter- 
views focused on the process of planning health services, 
the perceived scope for change given the current decentral- 
ization process, and the possible role of the intervention in 
this change. The program documents and interview tran- 
scripts were imported into NVivo 10 (QSR International Pvt. 
Ltd., Australia). Portions of text reflecting implementation 
assumptions, possible contextual factors (see step 3 below), 
and actors' perceptions were coded and analyzed using the- 
matic analysis. These themes were then summarized and the 
IPT was gradually constructed. 

(2) Literature review to identify possible mechanisms: we 
reviewed the published literature and identified possible 
steps through which capacity-building can lead to organiza- 
tional change. We began the literature search on the basis 
of four themes highlighted in the IPT: organizational com- 
mitment, self-efficacy, workplace learning, and evaluation 
of training programs. We conducted the search initially on 
Google Scholar and PubMed; we also scanned the references 
and carried out citation tracking of some of the papers we 
had retained, to identify other key publications (14). We 
finally retained articles (primary research, review articles, 
and reports) based on our assessment of the article's rele- 
vance to our program theory: organizational commitment 
(36 papers), self-efficacy (19 papers), workplace learning (6 
papers), and evaluation of training programs (57 papers). The 
list is presented in File S5 in Supplementary Material. 

(3) Identify contextual factors: we reviewed government reports 
and program documents related to performance of district 
health services (full list of documents in FUe S3 in Sup- 
plementary Material). We also analyzed the interview tran- 
scripts with participants of the intervention, co-workers of 
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Table 1 | Steps in building the program theory of the intervention. 
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the participants, policymakers, and implementers to identify 
contextual factors that could possibly influence the actors, 
the implementation, and the outcomes of the intervention. 
Key events that affected the implementation of the capacity- 
building intervention were also identified from the interview 
transcripts and these were mapped. The interview transcripts 
were imported into NVivolO (QSR International, Australia) 
and free coding was done to identify important factors pre- 
senting at various levels of the health system. The codes 
were then organized into trees and the themes emerging were 
summarized. 

(4) Refine program theory: we integrated possible mechanisms 
(from step 1 and 2) and contextual factors (from step 3) into 
the refined program theory. 

(5) Formulate CMO configurations: a framework for plausi- 
ble configurations of CMO was constructed from which 
empirically testable hypotheses can be drawn. 

We used the multipolar performance framework to analyze and 
discuss the refined program theory (28). This framework is an 
adaptation of a conceptual framework designed for analyzing the 
performance of healthcare organizations proposed by Sicotte et al. 
(29). It integrates several theories on organizational change and 
has been applied to explain healthcare organizations' performance 
in LMICs settings (1, 28-30). 

RESULTS 

We present the results of the five steps described above, followed 
by a discussion of the results using the multipolar performance 
framework. 

We first described the goal of the intervention, its rationale, 
the components of the intervention, the participants (and other 
actors involved), and the implementation timelines (File SI in 



Supplementary Material). For the purpose of this study, we will 
focus on two of the key expected outcomes of the capacity-building 
program viz. improved annual action plans at district and taluka 
level and improved supervision practices. These were the two 
major outcomes that the designers sought to influence through 
the capacity-building program. An interim self-evaluation of the 
intervention by the implementers, as well as an external evaluation, 
highlighted planning and supervision as possible key outcomes 
(31, 32). We then present the literature review and the context 
analysis, and eventually bundle the refined program theory and 
the CMO configurations. 

UNDERSTANDING THE INTERVENTION: INITIAL PROGRAM THEORY 

The IPT is readily available - see the publication of the study proto- 
col (15) - reproduced in Figure 2. The IPT is therein schematized 
as a linear representation of the intervention's inputs (contact 
classes and mentoring of participants) connected to the inter- 
vention's expected outcomes (improved annual action plans and 
supervision practices) through a set of intermediate steps (better 
problem and solution identification, better monitoring and more 
supportive supervision). The IPT considered the posting of non- 
medical management professionals at district and sub-district 
levels [as part National Rural Health Mission (NRHM) - see 
below for description of the NRHM] as a significant contextual 
factor, expected to influence the intervention's outcomes. Based 
on this IPT, the intervention could be formulated as a human 
resources management intervention consisting of an in-service 
training and mentoring program to bring about organizational 
change in district health management, through improved prepa- 
ration and implementation of annual action plans and supportive 
supervision. The IPT was represented as a logic model. However, 
from a realist evaluation perspective, it requires further elaboration 
by making explicit the assumptions of the program designers on 
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FIGURE 2 I The initial program theory of the intervention as conceived 
by the program designers. Reproduced from the study protocol (15). 



the possible intermediary steps and by taking into consideration 
the contextual factors that could affect the implementation of the 
intervention. Also, potential mechanisms of change need to be 
identified. 

Based on documentary review and thematic analysis of the 
interviews with the designers of the intervention, we identi- 
fied three key assumptions that a priori guided the design and 
implementation of the intervention. These assumptions have had 
implications on how the program was structured (e.g., role of 
experienced teachers visiting the participants as mentors, whom 
to include in the program), its content (e.g., what type of content 
to include and how to present them), and the implementation 
(e.g., focus on improving the district and taluka health system 
and focusing on health management teams at these levels). These 
assumptions are the following: 

An attitudinal change among the participants is needed to achieve 
the desired results 

The program implementers noted that improved public health 
management knowledge and skills are insufficient by themselves 
in bringing about change. They thought that an attitude toward 
creating organizational change among the participants is essential. 
The implementers sought to encourage or bring about such an atti- 
tudinal change by using particular styles of teaching (e.g., applying 
adult-learning techniques such as participatory and peer/group 
learning in the contact classes), letting participants identify exam- 
ples of glaring gaps in existing services, and mentoring participants 
at their own workplaces. The mentors were either the teachers from 
the contact classes or experienced public health professionals. They 
would visit the participants at their workplace, discuss topics raised 
in the contact classes, and offer to demonstrate or help implement 
the acquired knowledge and/or skills in the participants' work- 
place. The implementers described the changed attitude that they 



aimed for, as a can-do attitude. This was based on the perception 
of the designers that there was apathy and lack of desire to change 
things at the district and taluka level. The implementers assumed 
that the participation of experienced health professionals in men- 
toring visits could trigger such an attitude among the participants, 
and hence create an environment where the knowledge and skills 
would be put to effective use. 

The program can benefit from and tal(e into account alignment with 
existing policy initiatives 

The Indian government's flagship health program, the NRHM, is 
being implemented since 2005. The NRHM sought to bring about 
an architectural correction in the health system through improving 
financing arrangements and reforms in planning and supervision 
of health services. One of the reforms was decentralized plan- 
ning and management of health services to the district level (33). 
Our analysis shows that the program implementers felt that the 
objectives of the capacity-building program aligned with the new 
resources coming through the NRHM and NRHM's efforts at 
district level decentralization. They therefore included the newly 
created cadre of health managers at taluka and district level - the 
Block Program Managers (BPMs) at sub-district level and the Dis- 
trict Program Managers (DPMs) at district level - as participants 
in the intervention. They also identified the new system of decen- 
tralized planning at the district level as an opportunity for the 
district health team to implement organizational change through 
improved annual action plans and better supervision practices. 

Targeting individuals (for the capacity-building program) will 
produce impact through teams 

The implementers identified health management teams at hospi- 
tals, talukas, and disease-control programs as the unit for change 
within the health services. These teams included medical doctors 
and administrative staff, but also the newly introduced BPMs and 
DPMs. The implementers (and NRHM) expected that the induc- 
tion of these new cadres and the building of teams at taluka and 
district levels would improve local annual action plans; earlier, 
action plans were largely made at the state-level in a top-down 
fashion. The program implementers specifically targeted these 
enlarged management teams. 

The program theory incorporating the assumptions of the 
implementers is represented in Figure 3. 

REVIEW OF LITERATURE: HOW ARE CAPACITY-BUILDING 
INTERVENTIONS SUPPOSED TO WORK? 

Human resource management interventions can be important dri- 
vers of health service provision and thus good health outcomes. 
However, studies on HRM in health are few; they focus mainly on 
continuing education, supervision, payment of incentives, decen- 
tralization of HRM functions, or a combination of these (7, 34). 
An understanding of the mechanisms through which HRM inter- 
ventions produce change in healthcare institutions is crucial for 
the design and delivery of such interventions in LMICs settings. 
However, the current evidence base for how positive organiza- 
tional change could be achieved through capacity-building based 
HRM interventions in health services is scarce (7, 34, 35). Both 
systematic and realist reviews of studies in human resources for 
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health note that the role of context in producing desirable out- 
comes in HRM interventions is under-explored; either contextual 
factors are neglected in designing effectiveness evaluations, or con- 
text descriptions are scarce, rendering the studies not amenable to 
realist reviews (7, 22). 

Contrary to the evidence base on HRM in the public health 
literature, much has been written on the topic in management 
sciences, particularly in the corporate business industry ( ). 
In a review focusing on evidence on achieving and maintain- 
ing good performance of health workers in LMICs, Rowe et al. 
(34) identify eight theories underlying most HRM interventions 
in health. These theories explain organizational improvement 
through change in health worker behavior and practices, which 
they place across several levels: the team, the institution, and the 
larger health system environment within which they work. The 
theories reviewed are summarized in Figure 4. They could be 
thought of as providing explanations of change seen at individ- 
ual, institutional, and systems levels; however, Rowe et al. note 
that: "... Httle is known about how well the theories predict health 
worker practices or success of interventions." Furthermore, most 
studies included in their review concern healthcare workers. Stud- 
ies pertaining to local health system managers, mostly doctors in 
the case of Indian districts, are scarce. 

Capacity-building programs inject new resources, i.e., knowl- 
edge, skills, and experiences, in organizational settings. A variety 
of individual, institutional, and environmental factors determine 
who benefits from such programs and who does not, and who 
applies what they learnt in terms of organizational change, and 
who does not. Among the frameworks proposed to evaluate 
the effect of training programs, the Kirkpatrick and Kirkpatrick 
framework is one of the most frequently used (37). The frame- 
work proposes four levels at which the training programs could 
be evaluated: reaction (to the training), learning (knowledge and 
skills), behavior (applying the new learning), and impact (changes 
brought in the organization). In a critical analysis of evaluation 
practice, Bates (38) summarizes the common assumption (in lit- 
erature) of causal linkages between these four levels as follows: 
the four "... levels of criteria represent a causal chain such that 
positive reactions lead to greater learning, which produces greater 
transfer and subsequently more positive organizational results." 



Bates further notes that several training evaluation studies and 
meta-analyses have failed to confirm such a linear causal path- 
way connecting training program inputs to outcomes through 
these four levels (38). Although the four levels of the Kirkpatrick 
and Kirkpatrick framework therefore cannot be assumed to rep- 
resent an incremental four-level causal pathway, the framework 
provides possible sequential steps that an individual trainee might 
experience during and after training programs. It helps us by 
indicating where to look for contextual factors that could affect 
individual learning and its appHcation within the participants' 
organization. 

One of the key components of the IPT of the implementers 
was the intent to bring about a can-do attitude among the partici- 
pants. The implementers expected that mentoring by experienced 
pubhc health professionals at the workplace of the participant 
would bring about such an attitudinal change. The initial program 
documents, however, did not elaborate on how the implementers 
expect such a change to take place in the individual partici- 
pants. We had hypothesized that, in addition to organizational 
and environmental factors, such a positive organizational change 
could be linked to individual attributes of the participant, like 
the organizational commitment of the individual and the confi- 
dence that the individual places in his ability to produce such a 
change (15). The latter is related to perceived self-efficacy, iden- 
tified as a mechanism that explains why some people feel able 
to take up some tasks while others do not, in spite of similar 
knowledge and skiU levels (39). Similarly, organizational com- 
mitment and performance of an individual are closely related, 
as shown in several industrial and healthcare organizational 
settings (4! — _ ). 

In a local health system, where individual health managers 
work in small teams within organizations belonging to a broader 
network of healthcare institutions, the dynamic nature of the 
interactions at individual, team, institutional, and broader envi- 
ronmental levels contributes to whether participants apply what 
they learn and whether the expected organizational change mani- 
fests or not. Organizational frameworks therefore incorporate the 
role of such factors when analyzing healthcare organizational per- 
formance {~"^, ^'^). Workplace environment, nature of teams and 
teamwork, supervision received, attitude of state-level officials, and 



Frontiers in Public Healtli | Public Health Education and Promotion 



July 2014 I Volume 2 | Article 89 | 6 



Prashanth et al. 



Capacity-building of health managers in India 



Theories of behavioural change in health services 



Context 




Health promotion, 
innovation & social 
marketing 



Social learn 


ng and 


innovation 


social 


influence S 


power 


theori 


2S 




Theories in relation to sphere of influence 
Individual, System and context 



Theory 

Adult Learning theori 



Health promotion, innovation and 
social marketing theories 



Behavioural and learning theories 

Social learning and innovation 
theories, social influence and power 
theories 

Management theories, system theories 
Coercive approaches 



Assumptions 

Change occurs when individuals have 
personal experience with a problem 
and helped develop the solution 
Behaviours can be changed with clear 
and attractive products and messages 
that meet a need of the target 
audience 

Behaviours are a result of external 
stimuli 



Stages of change model, and the 
PRECEDE model 



Change occurs through the interaction 
and influence of important people, and 
through development of new social 
norms 

Errors can be prevented by improving 
the design of health systems and 
processes 

Change occurs because of pressure 
and control 

To change, individuals pass through 
stages (precontemplation, 
contemplation of change, preparation 
for change, action, and maintenance) 
and different interventions are needed 
at different stages 



Interventions based on theory 

Develop guidelines through local 
consensus, small-group interactive 
learning, problem-based learning 
Needs assessments, adapting change 
proposals to meet local needs, creating 
clear and attractive messages, and 
disseminating them via multiple 
channels 

Audit and feedback, reminders, 
modelling correct performance, 
incentives, sanctions, removing factors 
that are demoralising 
Use opinion leaders or respected peers 
to disseminate guidelines, pressure 
from patients to use an innovation 

Total quality management, total 
quality improvement approaches, 
changing structures and tasks 
Laws and regulations, licensing, 
budgeting, complaints procedures, and 
legal pursuits 

Predisposing strategies, to progress 
from precontemplation to 
contemplation {education activities, 
conferences); enabling strategies, to 
progress from contemplation to action 
[clinical guidelines); and reinforcing 
strategies, to progress from 
preparation to maintenance (audit and 
feedback, peer review} 



Adapted from Rowe et al. 2005. How can we achieve and maintain high-quality 
performance of health workers in low-resource settings? The Lancet. 366(9490): 
1026-1035. 

Institute of Public Health, Bangalore 2010 



FIGURE 4 |Theories of behavioral change in health services in relation to their sphere of influence. Based on the review of theories that explain 
behavioral change in health services by Rowe et al. (34). 



the needs and demands of the communities are all important fac- 
tors that can affect organizational change after capacity-building. 
The various sub-units of a district health system, their interac- 
tions and influence on organizational performance are visualized 
in Figure 1. 

Workplace environment in healthcare organizations has been 
identified as an important element explaining the application of 
learning from training programs in some settings, while not in 
others (44). In the conceptual framework of workplace learning 
proposed by Jacobs and Park, the inter- relationships between loca- 
tion of the training (learning occurs away from workplace), degree 
of planning (use of a systems approach), and an active role of the 
trainer were key variables in understanding workplace learning 
(45). Although not specific to healthcare organizations, this frame- 
work identifies important elements for developing the program 
theory of our intervention. 

ANALYSIS OF THE CONTEXT 

While the theoretical frameworks provide plausible pathways 
through which the intervention inputs and outcome could be 
related, for the outcomes to effectively occur, local conditions 
matter. From a realist evaluation perspective, these are contextual 
factors that facilitate (or hinder) the outcome - they are crucial in 
refining the program theory. Contextual factors have been shown 
to influence organizational change in healthcare settings (46-52). 



While it is unlikely that each and every possible contextual factor 
will be identified, a documentary and literature review may help 
identify the most important and more obvious ones, especially if a 
plausible causal chain can be used as an anchoring point. We also 
used the mapping of key events (Figure 5) as a guide to identify 
relevant contextual factors. 

We identified three key themes from the contextual analysis: 
the local effects of the ongoing decentralization of planning to 
district level in India, the acceptance and role of newly introduced 
non-medical program managers, and the local actors' conceptu- 
alization of the district health services as a system. Below, we 
discuss these in more detail and analyze implications for our 
evaluation. 

Pushes and pulls of a decentralizing bureaucracy 

While the NRHM formally introduced decentralized planning in 
2005, decentralization of the management of health services to 
the district level has been an old recommendation (53-56). Over 
the last decade, there has been an increasing trend of decentral- 
ization of planning and implementation of health care to the 
district level. There have also concurrendy been calls for caution 
against hasty application of decentralization (sometimes charac- 
terized as a "disruptive innovation") (57, 58), especially without 
creating an appropriate environment for decentralization to suc- 
ceed. Studies stress the need for proper institutional capacity and 
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FIGURE 5 I Key events in course of the capacity-building intervention. 



an enabling environment before undertaking decentralization of 
health bureaucracies (7, 59-61). 

The opportunity to conceive organizational change at their lev- 
els, through the design of their annual action plans, is an important 
contextual element for making sense of the response of Indian 
district health managers. Wherever health managers perceive this 
to be an opportunity, capacity-building programs may find fer- 
tile grounds and they can contribute to change planning practices. 
The available and perceived decision-spaces of health managers are 
another factor. For example, a recent study in Pakistan shows that 
perceived decision-space could vary from region to region, as well 
as among individuals within the same region (d2). Parallel to the 
decentralization of the health bureaucracy is the ongoing process 
of decentralized governance at district and lower levels. Panchay- 
ati Raj Institutions (PRIs) are composed of elected representatives 
of the local governments at village, taluka, and district levels. The 
health services at the district level and below have been made 
accountable to the PRI, albeit they continue technical reporting to 
health officials at state level. The shifts in power dynamics in favor 
of representatives of PRI are important determinants of organi- 
zational change at district level in Karnataka. Capacity-building 
programs could work through providing health managers with 
the necessary capacity to negotiate with PRI members, and utilize 
their formal decision-spaces more effectively. 

The relationship between decision-spaces available to health 
managers and their organizational commitment has been investi- 
gated. It has been shown that highly committed managers are able 
to bring about positive change through HUM interventions, even 
in settings where they have relatively constrained decision-spaces 
(43). Organizational commitment and decision-spaces available 
to health managers are important links in the pathway toward 
organizational change at the district level in health bureaucracies 
that are in the process of decentrahzing. 



Involvement of young management professionals in doctor-led 
teams 

The NRHM, as explained above, introduced management pro- 
fessionals with a non-medical background into the health ser- 
vices at district and taluka levels. Their short-term contract 
appointments are in contrast to permanently tenured appoint- 
ments of the doctor-health-managers in their team. These pro- 
gram managers were meant to strengthen planning and moni- 
toring practices. However, their contribution to improving these 
processes is dependent on their relative position within existing 
health management teams, which remain led by doctors. The 
action of BPMs interested in making changes is determined not 
only by their technical capacity, but also their informal power 
vis-a-vis the doctors leading the traditional taluka teams. The 
same holds for DPMs at district level. The implementers' ini- 
tial assumption (as well as that of NRHM itself) on the role 
of program managers in enabling better planning and monitor- 
ing definitely needs to be examined in relation to existing team 
dynamics. 

The district healtli services as a system 

The implementers' conception of a district health system as a 
complex system has guided the design and implementation of 
the intervention. Whether this approach resulted in creating truly 
functional teams of health managers depends on many individual 
and workplace factors. The implication of the team assumption on 
the performance of taluka and district participants therefore needs 
to be critically examined. In India, there is not much information 
on what a district health manager requires in terms of inputs, 
skills, and knowledge (63). Neither is there a well-established con- 
cept of a "district health team" among the health staff Health 
managers may not perceive themselves as being part of a broader 
system that is supposed to work together in steering the district's 
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FIGURE 6 I Mapping of the actors in the Karnatal<a district health system 
showing their reporting relationships. The various actors - state level 
officials (orange boxes), district administration (purple boxes), community 
participation platforms under NRHM (green boxes), health managers and 
health workers (blue boxes), other village-level health workers (light green), 
and private healthcare providers (gray boxes) -are shown. The actors targeted 
in the capacity-building intervention are circled. The yellow background 
indicates district health services. Abbreviations (in alphabetical order): 
administrative medical officer (AMO), Anganwadi worker (AWW), auxiliary 



nurse-midwife (ANM), Arogya Raksha Samiti (ARS - patient welfare 
committee), accredited social health activist (ASHA), block program manager 
(BPM), Chief Executive Officer (CEO), Deputy Commissioner (DC), district 
health mission (DHM), district health officer (DHO), District Surgeon (DS), 
health and family welfare (HFW), Karnataka Health Systems Development and 
Reforms Project (KHSDRP), male health worker (MHW), primary health 
center medical officer (PHC MO), Senior Health Inspector (SHI), Taluka Health 
Officer (THO), Village Health and Sanitation committee (VHSC), Zilla Panchayat 
(ZP - local self-government at the district level). 



healthcare institutions toward improved performance. There are 
in fact both structural and functional problems in conceiving the 
Indian district health managers as functioning in teams. 

Structurally, the district health services are separated into a 
health and hospital wring. Both wings have independent report- 
ing relationships to the state (see Figure 6). The health wing, in 
addition to management of smaller ( < 100 bed) secondary hospi- 
tals and primary care facilities, oversees the operation of the many 
disease-control programs (e.g., vector-borne diseases and tuber- 
culosis) and programs for reproductive and child health. Some of 
these programs have dual reporting lines: they report to the dis- 
trict health officer (DHO) as well as to dedicated disease-control 
program managers at the state level. 

In the Tumkur capacity-building intervention, the imple- 
menters adopted a systems approach toward training health man- 
agers, on the assumption that they effectively worked with func- 
tional teams in their workplaces. This is evident in the selection of 
relatively diverse cadres of staff in the training program and in the 



team approach while training and mentoring. For example, men- 
toring visits targeted teams and not individual participants. The 
contact classes included DHO, program officers and hospital heads 
(all of them doctors), BPMs and DPMs, the administrative officers 
of the hospitals, and senior nurse-administrators at taluka and dis- 
trict levels. Although the implementers' assumption was that the 
participants were members of a team of health managers, these 
teams were in fact not necessarily functional. Doctors are viewed 
as the health managers in charge, automatically sliding into and 
being accepted into positions of leadership and responsibility in 
their teams. New staffs are thus expected to enter into a report- 
ing relationship with the doctors and are seen as subordinate in 
knowledge and in function. The factors related to the age gap, to 
the team relationships between medical and non-medical mem- 
bers of the teams, and to the relative power positions of members 
of the management teams all influence the functionality of the 
teams, and the degree to which non-medical team members will 
take up responsibilities. 
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PUniNG IT ALL TOGETHER: THE REFINED PROGRAM THEORY AND 
CMO CONFIGURATIONS 

Capacity-building of district health managers and its contribution 
to organizational change is influenced by relationships between 
actors and among the components of the district health system. 
In Figure 3, we represented the refined program theory of the 
intervention. As described above, we did this by critically examin- 
ing the IPT and the assumptions of the implementers, in relation 
to existing literature on capacity-building and by drawing from a 
description of the most important aspects pertaining to the local 
context. 

The program theory enables us to formulate a number of 
CMO configurations that can be subsequently used in guiding 
the analysis of data collected in course of the intervention (see 
Figure 7; Table 2). The CMO framework provides a lens through 
which to analyze empirical cases and build explanations for pur- 
posively chosen cases of positive and negative outcomes among 
the participants and teams. For example, the program theory 
points toward an important intermediate outcome, the intention 
to make positive organizational change after a training program. 
The contextual analysis and review of literature have also indi- 
cated important factors - individual mechanisms, institutional, 
and systemic factors (local context) - which could be mapped on 
a CMO framework. In this case, the CMO frame would start with 
positing possible contextual factors and mechanisms that could 
together bring about an intention to make positive change within 
a healthcare organization (outcome). We formulated three such 
CMO formulations based on the refined program theory. These 
formulations can be tested using a mix of qualitative and quantita- 
tive data to explain how positive organizational change can occur 
in response to such capacity-building programs (Table 2). 

DISCUSSION 

PROGRAM THEORY AND REALIST EVALUATION 

A program theory is a way of representing the expected relation- 
ships between the elements of an intervention implemented in a 
given context and its expected outcomes. Programs introduce new 



resources into a dynamic system. A program theory is a "set of 
propositions regarding what goes on in the black-box during the 
transformation of input into output; that is, how, via treatment 
inputs, a bad situation is transformed into a better one" (64, 65). 
A PT could be conceptualized as a logical and ordered description 
of the relationships between the various constitutive elements of 
an intervention, and the plausible pathways through which they 
interact with the elements of the system to produce the expected 
outcome. It draws upon the assumptions that the implementers 
have made in designing and implementing the intervention. It 
also incorporates the response of various actors within the sys- 
tem to the intervention and other contextual factors that could 
influence these actors and their responses to the intervention. A 
program theory is thus a pathway with interacting elements, show- 
ing how the inputs of an intervention could lead to the expected 
outcomes, taking into consideration contextual elements and the 
assumptions of the implementers on how they could achieve the 
objectives of the intervention. 

In realist evaluation, Pawson and Tilley posit that programs 
are embedded in social systems. They stress the importance of 
understanding what works for whom, and under what conditions 
(66, 67). The realist evaluation approach focuses on the interac- 
tion between the mechanisms activated by the intervention and 
the context(s) in which it is implemented, specifically seeking to 
understand how this interaction in the various contexts produces 
changes that could lead to the outcomes (of interest to the eval- 
uation). It is one of the several context-sensitive approaches to 
evaluate health programs at district level in low resource settings 
(23). In keeping with this, the program theory should identify 
intermediate steps in the pathway connecting the inputs of the 
intervention to the outcomes, the relationships between the steps 
and the conditions under which these occur. While existing the- 
ories provide plausible explanatory mechanisms through which 
inputs and outcomes could be related, the systemic factors unre- 
lated to the intervention that could affect the outcome of the inter- 
vention (the context) are very important to understand how the 
intervention worked. Configurations of CMO based on program 



Pre/post 
questionnaire InCreaSS^ 

K&S 




Interviews 
6t self-assessment survey 



1 National Rurai Heaitti IMisslon ! 
■ I 



Intention to 
mal<e change 

Org. com 

Psurvey[ 



Interviews & 
observations 


V 




Apply 





District data 



Funds are 
better utilised, 
plans improve 



Improved health services 
& vertical program 
coverage and utilisation rates 









Interviews & 
observations 




1 Survey 


style of : 
supervision received | 


; Nature of engagement ! 
!with community piatformsj 



Interviews & 
observations 



District's support; 



for "change" ! 
in this taluka 



Interviews & 
observations 



Decentralisation & PRI involvement; 



FIGURE 7 I Revised program theory based on incorporation of the implementer assumptions, theory (literature review), and analysis of the context. 
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Table 2 | Table showing the progression from initial program assumptions toward explanatory mechanism, plausible contextual factors, and 
supporting theory, in relation to the expected outcome. 



Key IPT assumption 



Contact classes work 

through improving 
knowledge and/or skills, 
which are eventually 

applied. This results in 
improved performance 

Mentoring participants 
at workplace facilitates 
application of 
knowledge and skills 



A capacitated health 
manager can become 
an agent of positive 
organizational change 



Supporting theory 



Outcomes of training 

programs accrue through 
four hierarchical levels: 
reaction (to training 

program), learning, 
behavior, and impact (37) 

Workplace environment 
in healthcare 
organizations has been 
identified as an important 
element that explains 
application of learning 
from training programs in 
some settings, while not 
in others (44) 

High commitment 
management literature 
shows the potential for 
change by committed 
staff in settings where 
resources could be 
mobilized (24) 



Key contextual factor 



Team dynamics (nature of team 
and relationships) affects the 
individual with intention for 
positive change 

Socio-political environment in the 

taluka/district 

Nature of supervision and district's 
openness to "allow" change 



Decentralized action plans and 
decision-making at district and 
lower levels. State and higher 
levels' openness to change 
proposals 

Change proposals by districts are 
in line with state (or central) vision 
as well as address local needs 
(allocation and strategic alignment 
with external environment as per 
Sicotte et al.'s conceptual 
framework) (29) 



Plausible mechanism 
identifiable from 
IPT and theory 

Motivation of the 
participant toward positive 
organizational change - a 
"can-do" attitude in the IPT 



Nature of commitment to 
organization 



Self-efficacy 



Claiming and utilizing 
decision-spaces; 
organizational 
commitment and 
self-efficacy, in negotiating 
with superiors and 
community leaders 



Outcome of interest 



Intention to make positive 
changes 



Identify/seek opportunities 
to make positive change in 
the organization's 
performance 
Improved annual action 
plans - better situation 
analysis, problem 
identification, allocation, 
and utilization of resources 

Taluka and districts plan 
improves. They identify 
more needs, mobilize 
more resources from 
state, and utilize it better 
(efficiency - both allocative 
and technical - improves) 



theory could be seen as plausible explanations of what worked 
for whom, and under what conditions. CMO configurations wiU 
enable us to collect data and test how the change occurred, in 
addition to whether the change occurred (or not). A critical refor- 
mulation of the IPT on the basis of empirical research, taking 
into consideration the conditions that could affect the outcome 
(like for instance other initiatives with similar outcomes and/or 
contextual conditions favorable or hindering the outcome locally) 
would eventually improve our understanding of the mechanisms 
of change, as well as enable a scientific evaluation. 

IMPLICATIONS FOR EVALUATION OF DISTRICT LEVEL HRM 
INTERVENTIONS 

A district health system in India consists of a network of 
government-owned healthcare organizations providing primary, 
secondary, and tertiary care in addition to private hospitals and 
providers. A district or a taluka, ideally, would be the meeting 
point of top-down resource allocation and planning with bottom- 
up planning driven by local needs and people's demands. Both 
dynamics would need to be integrated in a manner that ensures 
a well-performing health service that is responsive and provides 
good quality and equitable healthcare. 

Local health systems at taluka and district level can be concep- 
tualized as complex adaptive systems, a network of inter-related 
and inter-dependent organizations, which are relatively similar, yet 
dynamically interacting with each other and their environment. 



From a complex adaptive systems perspective, a linear causal logic 
model cannot be applied to evaluate a local health system interven- 
tion. Local contextual factors contribute to determine differences 
in outcomes, even if the appropriate resources for change are intro- 
duced (68). For example, the lack of a supportive learning and 
working environment in a given taluka hospital will be a barrier 
to realize the expected outcome, despite the introduction of new 
knowledge and skills through a training program, while it would 
have the potential to achieve this outcome in yet another hospital, 
where such an environment would exist. 

ANALYZING LOCAL HEALTH SYSTEM PERFORMANCE: THE 
MULTIPOLAR FRAMEWORK 

A healthcare organization is a dynamic entity constantly inter- 
acting with a continuously changing environment through an 
internal dynamic exchange between its different functions. Based 
on a synthesis of several, often competing models of organiza- 
tional performance, Sicotte et al. proposed a conceptual frame- 
work for analyzing performance in healthcare organizations. The 
overall performance of a healthcare organization is seen as being 
"determined by the dynamic equilibrium resulting from contin- 
ual interaction of, and interchange among (these) four functions 
(attributes or properties of an organization)": attaining the orga- 
nization's goals and adaptation to its external environment on 
one hand and its internal environment (the organizational culture 
and values) and its production (healthcare outputs) on the other 
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FIGURE 8 I Organizational change inTumkur could be explained 
through identifying which of the alignments in the IVIultipolar 
framework were triggered by the intervention inputs. The figure is 
based on tlie multipolar framework for assessing liealtiicare organization 
performance (28, 29). 



(see Figure 8). This framework has been the basis for designing 
the multipolar performance framework, a heuristic that has been 
used to analyze performance of complex public sector healthcare 
organizations (30). 

The pushes and pulls of the four poles result in six alignments, 
and the resulting performance of a given healthcare organization 
could be conceptualized as the net result of how the management 
team deals with the pushes and pulls along these various axes. 
For example, in the case of our program theory, change proposals 
introduced by a given taluka management team need to be in line 
with the district's vision on one hand (allocation alignment) and 
the expectations of local actors (PRI members, community, and 
other actors at the taluka level) on the other (strategic alignment). 
In such a scenario, capacity-building interventions could operate 
through triggering changes in alignments, for example, by decreas- 
ing tensions in the allocation alignment through better negotiation 
skiUs provided to the taluka. The Tumkur capacity-buUding inter- 
vention implemented within the existing policy context of NRHM 
aimed to improve both allocation alignment (improved alloca- 
tion of financial, human, and technical resources for planning) 
and strategic alignment (strengthening role of districts in mak- 
ing their own action plans). However, our program theory shows 
that in the present Indian district context, improved organiza- 
tional performance would also need better contextual alignment 
(perceived decision-spaces of health managers and BPMs) and 
operational alignment (decreasing the social distance between 
doctors as leaders of health management teams and their other 
members, improved teamwork among the members of the team 
including the young program managers). 

Programs for capacity-building of health workers operate at 
and across several levels - individual, institution, and system - 
with the positive outcomes, in this case, improved management 
of health services vary from one institution to another, and across 
different healthcare delivery teams. In a hospital where the doc- 
tor would be able to decrease the perceived social distance between 
herself and the BPM, there is likely to be a better operational align- 
ment and higher chances of the BPM's improved knowledge and 
skills manifesting as improved organizational performance. These 



plausible explanatory CMO configurations need to be tested using 
program data to understand which of the many possible orga- 
nizational change mechanisms is operating in the Indian district 
setting. 

CONCLUSION 

Capacity-building programs in health systems are an important 
HRM intervention, especially where adverse health outcomes are 
linked to poor management of health services. However, HRM 
studies in health and in other sectors have shown that training 
does not automatically generate positive organizational change. 
Efforts to understand the conditions under which capacity- 
building results in positive organizational change are limited by 
methodological difficulties, insufficient descriptions of the con- 
text under which interventions operated, and lack of attributability 
of changes observed to the intervention inputs. In this paper, we 
have described the process of building a revised program theory 
beginning from the IPT of the implementers, based on a thorough 
understanding of the local context and integrating relevant theo- 
retical knowledge. This is helpful in understanding how, for whom, 
and under what conditions the intervention works. The resulting 
refined program theory clarifies the plausible causal links in the 
intervention, making it amenable for evaluation. 

Although the design and delivery of HRM interventions could 
be standardized, the institutional (hospital or taluka/ district) con- 
texts and socio-political contexts vary from one institution/taluka 
to another and across districts. The plausible mechanisms through 
which a capacity-building program in health could bring about 
organizational change lie at the individual (self-efficacy and orga- 
nizational commitment), teams (workplace characteristics), orga- 
nization or district level (organizational characteristics of health 
services at the district level and the nature of the reporting rela- 
tionships to levels above and below), and interaction with other 
talukas or healthcare organizations (local health systems). The 
Tumkur intervention has provided us with an opportunity to 
improve our understanding of these plausible mechanisms and 
their interactions with the context to produce a desirable outcome. 
The refined program theory can be used to further investigate how 
the capacity-building intervention worked, for whom it worked, 
and why. 
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